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DETAILED ACTION 

This action is responsive to communications: Amendment, filed on 6/10/06. 

Claims 1-27 are pending in this appHcation. Claims 1,9, 18, and 22 are 
independent claims. In amendment filed in 6/10/06, Claims 1,9, 18, and 22 were 
amended. 



Claim Rejections - 35 USC § 103 
The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 
Claims 22 and 25 are rejected under 35 U.S.C. 103(a) as being unpatentable over 

Lanier et al (US 5,588,104) in view of Esch et al. (US 5,283,639) further in view of 

Young (US 4,706,121). 

As per independent claim 22, Lanier et al teaches a method for placing virtual 
objects into video programs at a viewer's terminal (col 2, lines 36-47), comprising: 

receiving a plurality of virtual objects comprising first virtual object intended for 
the viewer's terminal and second virtual objects intended for other terminal (col 2, lines 
47-63; It is inherent in a network environment different virtual objects are displayed on 
different terminals); 
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receiving a video program including one or more virtual object locations, the 
video program including virtual object information for placement of virtual objects into 
the video program (col 2, lines 47-63); 

comparing the virtual object information and the received virtual objects to select 
virtual objects for placement in the virtual object locations (col 3, lines 32- 50); and 

inserting the selected virtual objects into the virtual object locations (col 2, lines 

47-63). 

However, Lanier fails to teach receiving through the television program delivery 
system, at the view's terminal, the virtual objects; 

Receiving, at the viewer's terminal, a group assignment matrix and a retrieval 
plan for the view's terminal and the other terminal, wherein the group assignment matrix 
and retrieval plan are received through the television program delivery system. 
Esch et al. teaches receiving through the television program delivery system, at the 
view's terminal, (column 11, lines 50-65, column 1, lines 30-40; it is inherent that the 
interactive contents created Esch's multiple media network will alternately delivered to 
user's terminal) the interactive programs; (column 9, lines 35-67) 

Receiving, at the viewer's terminal, a group assignment matrix and a retrieval 
plan for the view's terminal and the other terminal, (column 11, lines 50-65, column 1, 
lines 30-40) wherein the group assignment matrix and retrieval plan are received through 
the television program delivery system, (column 1, 42-column2, lines 70) 

It would have been obvious to an artisan at the time of the invention to include 
Esch's teaching with method of Lanier in order to allow server to distribute 
advertisement that is local and pertinent. 
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However, both Lanier and Esch fail to teach a group assignment matrix comprises 
reception site grouping and program categories thereby the viewer's terminal stores 
information relating to the program categories of its group. 

Young teaches a group assignment matrix comprises reception site grouping and 
program categories (column 2, lines 30-61) thereby the viewer's terminal stores 
information relating to the program categories of its group, (column 12, lines 45-column 
13, lines 60) 

It would have been obvious to an artisan at the time of the invention to include 
Young's teaching v^th method of Lanier and Esch in order to allow users to easily reduce 
the number of programs that they are desired to watch. 

As per claim 25, which is dependent on claim 22, Lanier, Esch, and Young teach 
the method of claim 22. Lanier further teaches wherein the inserting step occurs during a 
display of the video program (col 3, lines 32- 50). 

Claims 1-6, 8-14, 16-21, 23, 24, 26 and 27 are rejected under 35 U.S.C. 103(a) as 
being unpatentable over Lanier et al. (US 5,588,104) in view of Lanier et al. (5,588,139; 
Hereafter Lanier II) further in view of Esch et al. (US 5,283,639) further in view of 
Young (US 4,706,121). 

As per independent claim 1, Lanier et al. teaches a method for placing virtual 
objects in virtual object locations in a video program at a viewer's terminal (col 2, lines 
36-47), comprising: 
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receiving a plurality of virtual objects for use with one or more of the virtual 
object locations (col 2, lines 47-63);and 

inserting one or more of the received virtual objects into one or more of the 
virtual object locations during a display or storage of the video program at the viewer's 
terminal (col 3, lines 32- 50). 

However Lanier et al. doesn't teach storing the virtual objects in the viewer's 
terminals. 

Lanier II (5,588,139) teaches storing the virtual objects in the viewer's terminals 
(paragraph, 30). It would have been obvious to an artisan at the time of the invention to 
include Lanier II (5,588, 139)'s teaching with Lanier et al. in order to reduce network 
traffic. 

However, they both fail to teach receiving from the television program delivery 
system, at the view's terminal, the virtual object; 

Receiving, at the viewer's terminal, a group assignment matrix and a retrieval 
plan for the view's terminal and the other terminal, wherein the group assignment matrix 
and retrieval plan are received through the television program delivery system. 

Executing the retrieval plan at the viewer's terminal to instruct, based on the 
group assignment matrix, the viewers terminal to select one or more of the plurality of 
virtual objects. 

Esch et al. teaches receiving through the television program delivery system, at 
the view's terminal, (column 11, lines 50-65, column 1, lines 30-40; it is inherent that the 
interactive contents created Esch's multiple media network will alternately delivered to 
user's terminal) the interactive programs; (column 9, lines 35-67) 
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Receiving, at the viewer's terminal, a group assignment matrix and a retrieval 
plan for the view's terminal and the other terminal, (column 11, lines 50-65, column 1, 
lines 30-40) wherein the group assignment matrix and retrieval plan are received through 
the television program delivery system, (column 1, 42-column2, lines 70) 

Executing the retrieval plan at the viewer's terminal to instruct, based on the 
group assignment matrix, the viewers terminal to select one or more of the plurality of 
virtual objects. (Abstract) 

It would have been obvious to an artisan at the time of the invention to include 
Esch's teaching v^th method of Lanier in order to allow server to distribute 
advertisement that is local and pertinent. 

However, Lanier, Lanier II and Esch fail to teach a group assignment matrix 
comprises reception site grouping and program categories thereby the viewer's terminal 
stores information relating to the program categories of its group. 

Young teaches a group assignment matrix comprises reception site grouping and 
program categories (column 2, lines 30-61) thereby the viewer's terminal stores 
information relating to the program categories of its group, (column 12, lines 45-column 
13, lines 60) 

It would have been obvious to an artisan at the time of the invention to include 
Young's teaching with method of Lanier, Lainer II and Esch in order to allow users to 
easily reduce the number of programs that they are desired to watch. 
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As per claim 2, which is dependent on claim 1 , Lanier, Lanier II, Esch and Young 
teach the method of claim 1, Lanier ('104) further teaches the method wherein the step of 
inserting comprises: 

selecting a specific virtual object from the one or more virtual objects (col 2, lines 
63-67, col 3, lines 1-5). 

As per claim 3, which is dependent on claim 1, Lanier, Lanier II, Esch and Young 
teach the method of claim 2, Lanier ('104) further teaches the method comprising 
recording virtual objects watched data at the viewer's terminal (col 3, lines 5-20). 

As per claim 4, which is dependent on claim 3, Lanier, Lanier II, Esch and Young 
teach the method of claim 4, Lanier ('104) further comprising adjusting the selecting step 
based on the recorded virtual objects watched data (col 3, lines 5-20). 

As per claim 5, which is dependent on claim 1, Lanier, Lanier II, Esch and Young 
teach the method of claim 1, Lanier ('104) further teaches method comprising 

receiving updated virtual objects at the viewer's terminal (col 3, lines 32- 50); and 

Lanier et al. ('139) teaches storing the updated virtual objects in the viewer's 
terminal (paragraph, 30). 

As per claim 6, which is dependent on claim 1, Lanier, Lanier II, Esch and Young 
teach the method of claim 1 , Lanier et al. ('104) further teaches the method wherein at 
least one virtual object is an interactive virtual object including a link to a location remote 
from the viewer's terminal, further comprising: 

receiving an activation of the interactive virtual object; and 

connecting the viewer's terminal to the remote location (col 4, lines 1-14). 
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As per claim 8, which is dependent on claim 1 , Lanier, Lanier II, Esch and Young 
teach the method of claim 1, Lanier ('104) further teaches the method wherein the 
viewer's terminal is one of a set top terminal, a television, a personal computer, a satellite 
television receiver, a wireless telephone, an electronic book reader, and a PDA device 
(col 2, lines 17-25). 

As per independent claim 9, it is rejected with the same rationale as claim 1. 

Supra. 

As per claim 10, which is dependent on claim 9, Lanier, Lanier II, Esch and 
Young teach the terminal of claim 9, Lanier ('104) further teaches wherein the video 
programs include a virtual object placement plan, the processor comprising a comparison 
module that compares the virtual object placement plan and the stored virtual objects to 
determine a specific virtual object for placement in a specific virtual object location 
(Lanier et al col 2, lines 63-67, col 3, lines 1-5, Lanier et al ('139). paragraph 30). 

As per claim 11, Lanier et al. ('139) teaches the terminal of claim 10, wherein the 
virtual object placement plan is stored in the memory (paragraph, 30). 

As per claim 12, which is dependent on claim 9, it is of same scope as claim 5. 
(see rejection above) 

As per claim 13, which is dependent on claim 9. Lanier, Lanier II, Esch and 
Young teach the terminal of claim 9. However Lanier et al, doesn't teach wherein the 
processor comprises a virtual objects watched module that determines virtual objects 
watched at the terminal, the virtual objects watched data stored in the memory. Lanier et 
al. ('139) teaches a terminal wherein the processor comprises a virtual objects watched 
module that determines virtual object watched at the terminal (paragraph, 17), the virtual 
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objects watched data stored in the memory (paragraph, 30). It would have been obvious 
to an artisan at the time of the invention to include Lanier et al. (5,588, 139)'s teaching 
v^th the modified Lanier et al. and Esch in order to reduce network traffic. 

As per claim 14, which is dependent on claim 13, Lanier et al. and Esch teach 
the terminal of claim 13, wherein the processor adjusts the virtual object placement plan 
based on the stored virtual objects viewed data (col 3, Unes 32- 50). 

As per claim 15, which is dependent on claim 9, it is of the same scope as claim 6. 
(see rejection above) 

As per claim 17, which is dependent on claim 9, it is of the same scope as claim 8. 
(see rej ection above) . 

As per independent claim 18, it is rejected with the same rationale as claim 1. 

Supra. 

As per claim 19, which is dependent on claim 18, Lanier, Lanier II, Esch and 
Young teach the method of claim 18, Lanier ('104) further teaches the method wherein a 
viewer receives virtual objects for display based on viewer information including one or 
more of programs watched data, virtual objects watched data, viewer demographic data, 
and viewer entered data (col 3, lines 5-20). 

As per claim 20, which is dependent on claim 1 8, it is of the same scope as claim 
13. (see rejection above) 

As per claim 21, which is dependent on claim 18, Lanier, Lanier II, Esch and 
Young teach the method of claim 1 8, Lanier ('104) further teaches wherein the video 
program is stored and the inserting step occurs while the video program is stored 
(paragraph, 30). 
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As per claim 23, which is dependent on claim 22, it is of the same scope as claim 
1. (see rejection above) 

As per claim 24, which is dependent on claim 22, it is of the same scope as claim 
21. (see rejection above). 

As per claim 26, which is dependent on claim 22, Lanier, Lanier II, Esch and 
Young teach the method of claim 22. However Lanier et al ('104) doesn't teach wherein 
the inserting step occurs during receipt of the video program. Lanier et al. ('139) teaches 
a method wherein the inserting step occurs during receipt of the video program 
(paragraph, 30). It would have been obvious to an artisan at the time of the invention to 
include Lanier et al. (' 139)'s teaching with the modified Lanier et al. in order to reduce 
network traffic. 

As per claim 27, which is dependent on claim 22, Lanier, Lanier II, Esch and 
Young teach the method of claim 22. However Lanier et al ('104) doesn't teach wherein 
the video program is displayed multiple times at the viewer's terminal, and wherein 
virtual objects inserted into the video object locations vary with one or more of the 
multiple displays of the video program. Lanier et al. ('139) teaches wherein the video 
program is displayed multiple times at the viewer's terminal, and wherein virtual objects 
inserted into the video object locations vary with one or more of the multiple displays of 
the video program (paragraph, 20). It would have been obvious to an artisan at the time 
of the invention to include Lanier 11' s teaching with the modified Lanier et al. in order to 
create the appearance and reactions of virtual environment and virtual participants are 
entirely within the control of the user. 
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Claims 7 and 16 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Lanier et al. (US 5,588,104) in view of Lanier et al. (US 5,588,139) further in view of 
Esch et al. (US 5,283,639) further in view of Young (US 4,706,121) further in view of de 
Hond (US 5,737,533). 

As per claim 7, which is dependent on claim 6, Lanier, Lanier II, Esch and Young 
teach the method of claim 6. However they fail to teach the method wherein the remote 
location is an Internet web site. De Hond teaches the method wherein the remote location 
is an Internet web site (col 5, lines 58-60). It would have been obvious to an artisan at 
the time of the invention to include de Hond's teaching with Lanier, Lanier II, Esch and 
Young in order to provide the users with more information regarding the subject. 

As per claim 16, which is dependent on claim 15, it is of the same scope as claim 
7. (see rejection above) 

Response To Arguments 

Applicant's arguments with respect to claims 6/10/06 have been considered but 
are deemed to be moot in view of the new grounds of rejection. 

Contact Information 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Peng Ke whose telephone number is (571) 272-4062. The 
examiner can normally be reached on M-Th and Alternate Fridays 8:30-5:00. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Kristine L. Kincaid can be reached on (571) 272-4063. The fax phone 
number for the organization where this application or proceeding is assigned is 571-273- 
8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. Status 
information for unpublished applications is available through Private PAIR only. For 
more information about the PAIR system, see http://pair-direct.uspto.gov. Should you 
have questions on access to the Private PAIR system, contact the Electronic Business 
Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO 
Customer Service Representative or access to the automated information system, call 
800-786-9199 (IN USA OR CANADA) or 571-272-1000. 



Peng Ke 
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